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Absence of Translational Symmetry Breaking in Nonmagnetic Insulator 
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The ground-state properties of the two-dimensional Hubbard model with nearest-neighbor and 
next-nearest-neighbor hoppings at half filling are studied by the path-integral-renormalization- 
group method. The nonmagnetic-insulator phase sandwiched by the the paramagnetic-metal 
phase and the antiferromagnetic-insulator phase shows evidence against translational symmetry 
breaking of the dimerized state, plaquette singlet state, staggered flux state, and charge ordered 
state. These results support that the genuine Mott insulator which cannot be adiabatically 
continued to the band insulator is realized generically by Umklapp scattering through the effects 
of geometrical frustration and quantum fluctuation in the two-dimensional system. 

KEYWORDS: nonmagnetic insulator, geometrical frustration, Mott transition, two-dimensional Hubbard model, 
path integral renormalization group method (PIRG) 
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The Mott transition between the metallic and insulat- 
ing states has been a subject of general interest in con- 
densed matter physics. 1 -' Many intensive studies have 
been done to clarify the nature of the Mott transition 
by employing analytical and numerical methods. 2 ' The 
present understanding on the Mott transition is that al- 
most all the Mott insulators have translational symmetry 
breakings such as AF ordering and dimerization in the 
ground state with only a few exceptions. 2 ' When the 
translational symmetry is broken, the Brillouin zone is 
folded so that the even number of electrons is contained 
in the unit cell. 3 ' These cases may be adiabatically con- 
tinued to the band insulator by the band-gap formation, 
and may not belong to the class of the genuine Mott 
insulator which has the odd number of electrons in the 
unit cell. 

For theoretical models, an exception of the Mott in- 
sulator without Brillouin zone folding is found in the 
ground state of the one-dimensional Hubbard model at 
half filling, where neither symmetry breaking nor spin 
excitation gap exists. 4 ' The absence of symmetry break- 
ing in the ground state implies that a highly quantum- 
mechanical state is realized. Then, the following question 
arises: Does the Mott insulator without translational 
symmetry breaking exist except in one-dimensional sys- 
tems? This has been a long-standing problem since An- 
derson's proposal in 70's. 5 ' He originally considered a 
spin- 1/2 model on the triangular lattice, which may re- 
alize the genuine Mott insulator by the combined effects 
of strong magnetic frustration and quantum fluctuation, 
although there exists an argument for the presence of a 
magnetic long-ranged order in this system. 6 ' 7 ' Recently, 
the Hubbard model on anisotropic triangular lattice has 
been studied. It shows the presence of the nonmagnetic- 
insulator (NMI) phase near the boundary of the metal- 
insulator transition. 8 ' 



In this letter, we consider the Hubbard model on 
square lattice (HMSL) with nearest and next-nearest 
neighbor hoppings at half filling as a candidate for the 
genuine Mott insulator. Effects of geometrical frus- 
tration (see Fig. 1(a)) and quantum fluctuation are 
expected to induce highly quantum-mechanical effects 
in this system. Recent weak-coupling renormalization 
group study suggests possible mechanism of insulat- 
ing gap formation through Umklapp scattering without 
any translational symmetry breaking. 9 ' Recent path- 
integral-renormalization-group (PIRG) study has clearly 
shown the presence of an insulating phase without mag- 
netic long-range order in intermediate to strong-coupling 
regime. 10 ' It is crucially important to fully understand 
the nature of the nonmagnetic Mott insulator phase and 
also the metallic phase near the metal-insulator bound- 
ary. We study various correlation functions to get in- 
sight into this problem. Our results support that the 
nonmagnetic-insulator phase does not show apparent 
translational symmetry breaking near the band-width- 
control Mott transition. 
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Fig. 1. (a) Lattice structure of the two-dimensional Hubbard 
model on square lattice with transfers t and t' . (b) Fermi surface 
for t = l,t' = -0.5 and U = 0.0 at half filling oniV = 100 X 100 
lattice (filled circle) and magnetic Brillouin zone (solid line). 
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The HMSL we consider is 
H = - ( C L C 3<r + C ]a C i<?) + u ^n^nu, (1) 

where (ct ) is the annihilation (creation) operator on 
the i-th site with spin a and rii a — c\ a Ci a in the TV-site 
system. The transfer integral is taken as ty = t for the 
nearest-neighbor sites and tij = t' for the next-nearest- 
neighbor sites. Throughout this letter, we take t as en- 
ergy unit and consider the half-filled case, ~Y^ia (riia) /N — 
1. 

We have applied the PIRG method 11 ' 12 ) to eq. (1). 
This algorithm starts from and improves the mean-field 
Hartree-Fock solution by increasing the dimension of 
truncated Hilbert space in non-orthogonal basis opti- 
mized by the path-integral operation. A variance ex- 
trapolation of improved wave function has been taken to 
reach the true ground state of finite systems in a con- 
trolled way. This method does not have difficulties as in 
previous methods such as the negative sign problem in 
the quantum Monte Carlo calculations. The PIRG calcu- 
lations have been done in the systems up to TV = 12x12 
lattices under the periodic boundary condition. 

First we discuss the change of the Fermi surface (FS). 
The FS can be defined by the q points where the momen- 
turn distribution n(q) = ^T^a^Ma^)^'^'^ 
exhibits a sharp discontinuity. We show the contour plots 
of |V q n(q)| in Fig. 2(a) to estimate the FS for t = 1 and 
t' = —0.5 on the N = 12 x 12 lattice. The large values 
of |V q n(q)| specify the possible location of the FS in the 
momentum space. We see that V q n(q)| has larger val- 
ues around q = (tt/2, 7t/2) than those around q = (0, tt) 
and (tt, 0). This indicates that renormalization of elec- 
trons occurs around both ends of the arc of the FS more 
prominently rather than around the center of the arc. 
Although it is difficult to demonstrate the validity of the 
Luttinger's theorem within the present analysis due to 
the finite-size effects, we note that there exists the fol- 
lowing tendency concerning the shape of the FS: As U 
increases, the FS around q = (tt/2, tt/2) tends to expand 
to the q — (tt, tt) point and the FS around the ends of the 
arc tends to shrink to the q = (0,7r) and (tt,0) points. 
This can be also seen from the contour plots of n(q) in 
Fig. 2(b) U = 3.5, (c)U = 4.0 and (d)U = 7.5. The large 
values of |V q n(q)| roughly correspond to the yellow area 
of the contour plot of n(q) as seen from Fig. 2(a) and 
Fig. 2(c). The metal-insulator transition is estimated at 
U c x = 4.75 ± 0.25 by the calculations of charge gap and 
double occupancy, and the antiferromagnetic transition 
specified by vector Q = (tt, tt) in spin correlation func- 
tion, S(q) = ^ Ef 3 ( s » ' Sj)e iq '( R4 - R 3), is estimated at 
U c2 = 7.25 ± 0.25. 10 ) Although the FS does not exist in 
the insulator phase, we also show here the contour plot 
of n(q) in the antiferromagnetic-insulator (AFI) phase 
in Fig. 2(d) to see the tendency of the deformation of 
the contour line of the Fermi level. From Figs. 2(b)-(d), 
we see that the FS deforms from the U = FS toward 
the magnetic Brillouin zone specified by the vector Q, 
which are represented as the filled circles and the solid 
line, respectively in Fig. 1(b). Namely, the FS deforms 



toward the perfect nesting as U increases. This tendency 
has been predicted by the renormalization-group study 
on the HMSL in the weak-coupling regime. 13 ) 




Fig. 2. Contour plots of V q ri(q) for (a)[/ = 4.0 and n(q) for 
(b)U = 3.5, (c)4.0, and (d)7.5 for t = 1, t' = -0.5 on the N = 
12 X 12 lattice at half filling. PM and AFI represent paramagnetic 
metal and antiferromagnetic insulator, respectively. 



Next we discuss the nature of the NMI phase. In the 
NMI phase for U c \ < U < U C 2, S(q) has broad peaks 
at incommensurate positions shifted from q = (tt, tt) to- 
ward q = (0, ±7r) and (±7r, 0) directions, in contrast to 
the AFI phase for U > t/ c2 with the commensurate peak 
at q = Q. 10 ) A remaining question to be clarified is 
whether some other translational symmetry is broken, 
or not in the NMI phase. To examine the nature of 
the NMI phase let us consider the U/t — > oo limit of 
the phase diagram. In the strong-correlation limit, the 
HMSL becomes the J\-Ji Heisenberg model in the lead- 
ing order: H = J x J2(i,j) s * ' S j + J 2 12{i,j} s i ' s i> where 
(} and {} represent the nearest-neighbor sites and next- 
nearest-neighbor sites, respectively. Here, J\ — 4t 2 /U 
and J2 = 4:t' 2 /U are both antiferromagnetic interactions 
so that magnetic frustration arises. For J2/J1 ^ 0.4 the 
Neel order with peak structure in S(q) at q = (tt, tt) was 
proposed while for J2/J1 l<2 0.6 the collinear order with 
q = (0, tt) or (tt, 0) peak in S(q) was proposed. However, 
as for the intermediate region of 0.4 ^ J2/J1 Ss 0.6, no 
definite conclusion has been drawn on the nature of the 
ground state: The possibility of the columnar-dimerized 
state 14 ' 15 ) (see Fig. 3(a)), the plaquette singlet state 16 - 1 
(see Fig. 3(b)) and the resonating-valence-bond 17 ) state 
was discussed. The AFI and the NMI phases found in 
the HMSL can be connected to the Neel-ordered and the 
NM phases of the J\- J2 Heisenberg model, respectively, 
in the limit U/t — > 00. Therefore, the NMI phase in the 
phase diagram of the HMSL could have some connection 
to the region 0.4 £ J 2 /Ji ^ 0.6. 

We first note that it is in principle hard to prove the 
existence of the genuine Mott insulator because it is diffi- 
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Fig. 3. Schematic pictures of (a) the columnar-dimerized state 
and (b) the plaquette-singlet state. 



cult to prove the absence of all the possible translational 
symmetry breakings. To get insight into this problem, we 
examine every symmetry breaking ever proposed, which 
is likely to occur in the NMI phase. 

To examine the possibility of the dimerized state 
and the plaquette state, we have calculated the dimer- 
correlation function D a p for a,/3 = x,y defined by 
D al3 = {O a O f3 ), where O a = ^£^(-1)% ■ S i+& , 
and a represents the unit vector in the a(=x or y) di- 
rection. Figure 4 shows the system-size dependence of 
D xx for t' = -0.5, and U = 0.0, 3.5, 4.5, 5.0, 5.7 and 
8.0 on the N = 4 x 4, 6 x 6, 8 x 8, 10 x 10 and 12 x 12 
lattices. We note that the dimer correlation is enhanced 
in comparison with U = results and it indicates that 
short-ranged correlation develops. The extrapolated val- 
ues of D xx to the thermodynamic limit, however, seem to 
vanish for all interaction strength calculated here. These 
results indicate that the columnar-dimerized state and 
the plaquette-singlet state (see Fig. 3) proposed as a 
candidate for the NMI phase with broken translational 
symmetry are not realized in the present system. The 
D xy correlations have about 2- or 3-orders of magnitude 
smaller values than the D xx correlations for each system 
size and the extrapolation to the thermodynamic limit 
also shows no realization of the D^-type ordering. 
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Fig. 4. The system-size dependence of the dimer-corrclation 
functions for t = 1.0, t' = —0.5 and U = 0.0 (open cir- 
cle), 3.5 (filled square), 4.5 (open square), 5.0 (filled triangle), 
5.7 (open diamond) and 8.5 (open triangle) at half filling on 
N = 4 X 4, 6 X 6, 8 X 8, 10 X 10 and 12 X 12 lattices. 



Next, we examine symmetry breaking of various den- 
sity waves proposed in the literature. 18 ^ We calculate 



the current-correlation function defined by 

C a (q) = (J«(q)4(q)) , 

where J Q (q) = i £ k (T 4,<r c k+q,a/a(k), with / x (k) = 
cos(fc x ) + cos(fc„), / 2 (k) = cos(k x ) - cos(k y ), / 3 (k) = 
2 cos(k x ) cos(ky), and /4(k) = 2 sin^) sin(k y ). 

Among finite q, we have confirmed that the peak 
structure in C Q (q) for a = 1,2,3 and 4 appears at 
q= 0r,7r) = Q for t' = -0.5, and U = 0.0, 3.5, 4.5, and 
5.7. Here C^Q) corresponds to the so-called staggered- 
flux state 18 ) (see inset of Fig. 5(b)). Figure 5 shows the 
system-size dependence of |C Q (Q)|, for t' = —0.5, and 
U = 0.0, 3.5, 4.5 and 5.7 on the N = 4 x 4, 6 x 6, 8 x 8, 
10 x 10 and 12 x 12 lattices. If the long-ranged order of 
these types occurs, |C Q (Q)| should have a finite value in 
the thermodynamic limit. Although |C Q (Q)| for a = 1 
and 2 are enhanced in comparison with U = results, 
all current correlations calculated here seem to vanish for 
N — > oo and the correlations remain short ranged. These 
results suggest that the symmetry breaking specified by 
the order parameter, J Q (q) for a = 1, ..,4 does not occur 
in the NMI phase. 

We have also calculated the charge-correlation func- 
tion defined by 



N(q) 



1 

N 



N 

E 



{{riiTij) - (ni)(nj))e 



iq (R — Rj 



with m = J2a c i<T C i<y- We show A^(q) in Fig. 6 for (a)U = 
0.0, (b)4.5, (c)5.0, and (d)5.7 for t' = -0.5 on the N = 
12 x 12 lattice. No conspicuous peak structure develops 
even in the NMI phase such as U = 5.0 and 5.7. Figure 7 
shows the system-size dependence of N(Q)/N, for t' — 
-0.5, and U = 0.0, 3.5, 4.5, 5.0 and 5.7 on the N = 4 x 4, 
6x6, 8x8, 10x10 and 12 x 12 lattices. The extrapolation 
of maximum values of A^(q) to N — * oo goes to zero 
for all interaction strength calculated here. The absence 
of prominent peak structure in A^(q) in various system 
sizes excludes the possibility of incommensurate charge 
orderings. Thus, we conclude that the charge order does 
not occur in the NMI phase. 



In summary, we have studied the ground-state prop- 
erties of the Hubbard model on the square lattice with 
nearest-neighbor and next-nearest-neighbor hoppings at 
half filling by using the PIRG method. We show that 
the renomalization of electrons occurs in the metallic 
phase drastically around q = (0, tt) and (it, 0) rather 
than around q = (ir/2,ir/2). There exists a tendency 
that the Fermi surface deforms toward the magnetic Bril- 
louin zone as U increases, namely, toward the perfect 
nesting. In the nonmagnetic-insulator phase sandwiched 
by the paramagnetic-metal and the antiferromagnetic- 
insulator phases, the calculations of dimer-, current-, and 
charge-correlation functions show no evidence of sym- 
metry breakings such as the columnar-dimerized state, 
plaquette-singlet state, staggered-flux state (d-density- 
wave state), s-density-wave state, and charge-ordered 
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Fig. 5. The system-size dependence of current correlations 
|C a (Q)| at Q = (-7T, it) with (a) /i = cos(k x ) + cos(k y ) (b) 
/2 = cos(k x ) - cos(fc !/ ), (c) / 3 = 2cos(fc :l: ) cos(fc a ), and (d) 
/ 4 = 2sin(fc a ,)sin(A; I/ ) for t = 1.0, t' = -0.5 and U = 0.0 (open 
circle), 3.5 (open triangle), 4.5 (filled square) and 5.7 (open di- 
amond) at half filling on N = 4 X 4, 6 X 6, 8 X 8, 10 X 10, and 
12 X 12 lattices. Inset of (b) illustrates schematic picture of the 
staggered-flux state. 



state. Although a possibility of some other symme- 
try breakings cannot be excluded, our results support 
that the Mott insulator without translational symme- 
try breaking is realized in the nonmagnetic-insulator 
phase, where the translational symmetry breakings un- 
dergo quantum melting. This implies that the genuine 
Mott insulator which can not be adiabatically continued 
to the band insulator is realized by Umklapp scattering 
via the effects of geometrical frustration and quantum 
fluctuation near the metal-insulator phase boundary. 

We thank S. Sachdev for discussions. The work is sup- 
ported by the 'Research for the Future' program from the 
Japan Society for the Promotion of Science under grant 
number JSPS-RFTF97P01103. A part of our computa- 
tion has been done at the supercomputer center in the 
Institute for Solid State Physics, University of Tokyo. 
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Fig. 6. The charge correlation functions for t = 1.0, t' = —0.5, 
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